Europaisches Patentamt 
European Patent Office 
Office europ€en des brevets 



© Publication number: 



0 545 446 A1 



EUROPEAN PATENT APPLICATION 



© Application number: 92120832.8 
© Date of filing: 07.12.92 



© int. CI. 5 : H04N 1/21, G1 1 B 27/1 1 



® Priority: 05.12.91 US 803245 

© Date of publication of application: 
09.06.93 Bulletin 93/23 

© Designated Contracting States: 
DEFRGBITNL 



© Applicant: EASTMAN KODAK COMPANY 
343 State Street 

Rochester, New York 14650-2201 (US) 

© Inventor: Parulski, Kenneth A,, c/o Eastman 
Kodak Company 

Patent Legal Staff, 343 State Street 
Rochester, New York 14650-2201 (US) 



© Representative: Wagner, Karl H. 
WAGNER & GEYER Patentanwalte 
Gewuerzmuehlstrasse 5 Postfach 22 14 39 
W-8000 Munchen 22 (DE) 



© Method and apparatus for providing multiple programmed audio/still image presentations from a 
digital disc image player. 



© An apparatus and method are provided for use 
with a system including a digital data base for stor- 
ing digitized images and digitized audio messages, 
for controlling concurrent reproduction of digitized 
images on an image reproduction device and audio 
information on a sound reproduction device. The 
digitized images are stored as image data files in the 
digital data base. Likewise, the digitized audio mes- 
sages are stored as audio data files in the data base. 
Audio messages and images are associated with 
each other. This is accomplished by means of a 
presentation sequences file stored in the data base 
or in a separate EEPROM memory. In response to a 
!■» user command, a controller causes image data and 
^ audio data for a selected image and an accompany- 
ing audio message to be read from the data base, 
^j* The respective data are provided to the image re- 
^ production device and the sound reproduction de- 
Ifj vice, respectively, whereby the audio message is 
^ played back by the sound reproduction device as 
Ift the image is displayed on the image reproduction 
© device. A controller maintains the display of the 
image for the duration of the audio message. The 
ffi controller reads a sequence of images and audio 
messages from the data base and displays each 
image and plays back one or more associated audio 



messages in turn. 
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FIELD OF THE INVENTION 

The present invention generally relates to the 
storage and reproduction of digitized sound and 
images, and is particularly directed to a method 
and an apparatus for reproducing digitized photo- 
graphic images on a display monitor and playing 
back audio information concurrently with display of 
such images. 

BACKGROUND OF THE INVENTION 

Copending EP application Serial No. 
91916719.7 filed September 11, 1991, entitled 
"Multiresolution Digital Imagery Photofinishing Sys- 
tem", by S. Kristy, assigned to the assignee of the 
present application and the disclosure of which is 
herein incorporated, describes a digital image pro- 
cessing system wherein photographic still images, 
such as those captured by way of a 35mm camera, 
are digitized and recorded on an optical compact 
disc (CD), for subsequent playback on a CD player. 
Image data files are created by scanning the im- 
ages on a roll of developed photographic film to 
produce digitized pixel data for the images, and 
storing the pixel data as image data files. A rela- 
tively permanent digital storage medium, such as 
an optical disc readable by a laser pickup, is then 
produced. A user having such a disc loads the disc 
into a disc player coupled to a display unit such as 
a video monitor or television. Then, by entering 
suitable commands into the disc player or a sepa- 
rate control unit, the user displays selected images 
on the display unit. 

A low cost, reduced complexity frame 
store/data retrieval architecture, incorporated into a 
CD player and which provides for rapid call-up of 
images stored as digitized image data and display 
of the images on a consumer television color moni- 
tor, is described in a co- pending EP patent ap- 
plication, Serial No. 91917852.5 filed Sept. 2, 1991, 
entitled "Mechanism for Controlling Presentation of 
Displayed Image". A presentation control file in the 
data base corresponds with each image data file. 
The presentation control file contains orientation 
and aspect ratio information, so that the image 
playback device will know how each image has 
been stored on the database and will therefore 
know how to access the stored image so that it is 
played back in a proper upright condition. 

The presentation control file included in the 
database, which is typically recorded using a write- 
once optical disc and cannot be altered by a con- 
ventional CD player, can be augmented or super- 
seded by image parameter data stored in by a 
separate storage medium, such as an electrically- 
programmable read only memory module. Such a 
module may be either fixed inside the CD player or 



may alternately be removable from the player, and 
may be configured to store customized image dis- 
play parameters including contrast, image mag- 
nification, color balance, etc., as described in a co- 

5 pending EP patent application, Serial No. 
91917547.1 , filed , entitled "Auxiliary Re- 
movable Memory for Storing Image Parameter 
Data" by K. Parulski et al, assigned to the assignee 
of the present invention and the disclosure of which 

w is herein incorporated. 

More particularly, this application discloses an 
improved storage and retrieval mechanism for a 
digital image processing system wherein a plurality 
of photographic images that have been captured on 

75 a photographic film strip are digitized for process- 
ing and subsequent display. Digitized images are 
stored on a digital data storage recording medium, 
such as a compact disc, which is capable of being 
coupled to an image playback device for reproduc- 

20 tion of a digitized image on a display such as a 
color TV monitor. A photofinisher having suitable 
equipment scans developed film and produces an 
optical disc, and then provides the disc to the 
customer along with the developed film. 

25 Subsequently, when the customer inserts the 

disc into a playback device, such as a compact 
disc player, for driving an output display, such as a 
color TV monitor, the playback device decodes the 
presentation control file information in the course of 

30 reading out the digitized image, and uses the pre- 
sentation control file to control the playback device 
in such a way as to display the image in an upright 
orientation and at the correct aspect ratio for the 
display. If the aspect ratio is such that the dimen- 

35 sions of the image do not match the dimensions of 
the display, a border generator fills in non-acces- 
sed pixel addresses to complete the image on the 
display. 

In various applications in which multimedia in- 

40 formation is to be conveyed, it would be desirable 
to provide synchronized images and audio mes- 
sages. For instance, in a museum, a display in- 
cludes a plurality of still images such as color 
slides and corresponding audio messages, such as 

45 narration, sound effects, etc. As another example, a 
sales demonstration may include a series of im- 
ages accompanied by sound tracks or voiceovers 
which vary in language, content, etc., depending on 
the market which is to be targeted. Furthermore, it 

so would be desirable to be able to easily rearrange 
the images and audio segments into a variety of 
different sequences, which may be appropriate for 
different audiences, or in response to different user 
inputs, for example, from different push-buttons in 

55 a museum walk-up display. 

Audio information such as voice, music, sound 
effects, etc., can also be stored in digital form and 
played back on a separate audio system. However, 
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it is difficult to synchronize separate audio and 
image systems, particularly if the systems together 
are to provide different associated images, audio 
messages, etc., and difficult to allow for convenient 
editing, such as resequencing audio messages and 
images, or changing the audio message with which 
an image is associated, in such a system. Also, if 
separate audio and video display systems are used 
for a multimedia presentation, the cost and bulk of 
the two separate systems are undesirably large. 

SUMMARY OF THE INVENTION 

In order to provide a convenient, self-contained 
system for displaying images and concurrently 
playing back associated audio messages, there is 
provided an apparatus, for use with a system in- 
cluding a digital data base for storing respectively 
corresponding digitized images and digitized audio 
messages, for controlling concurrent reproduction 
of digitized images on an image reproduction de- 
vice and audio information on a sound reproduction 
device. 

The digitized images are stored as image data 
files in the digital data base. Likewise, the digitized 
audio messages are stored as audio data files in 
the same data base. In accordance with the inven- 
tion, audio messages and images may be asso- 
ciated with each other. This is accomplished by 
means of a mapping arrangement, which may in- 
clude a mapping table including addresses or IDs 
of pairs of associated images and audio messages 
or IDs of associated files stored in headers or 
presentation control files associated with the image 
and audio data files. 

In particular, an application of the invention for 
conveying information on a given subject, involves 
displaying a sequence of images, each with its own 
corresponding audio message. The system in- 
cludes a library of images and audio messages 
large enough to encompass several sequences of 
slides and audio messages. In some cases, a sin- 
gle image appears in two different sequences on 
two different subjects, having different correspond- 
ing audio messages, or vice versa. To allow for 
individual image viewing, information editing, etc., 
the system is not limited to sequences of images 
and audio messages stored in contiguous address- 
es of the data base. Rather, the system includes 
means, such as a "utility table in the data base, for 
selecting any image or images, without regard to 
the sequence in which the images are stored in the 
data base, and for reading and playing back an 
associated audio message while each image is 
displayed. 

Responsive to a user command, a controller 
causes image data and audio data for a selected 
image and an accompanying audio message to be 



read from the data base and loaded into respective 
image and audio memories. The respective data 
are provided to the image reproduction device and 
the sound reproduction device, respectively, where- 

5 by the audio message is played back by the sound 
reproduction device as the image is displayed on 
the image reproduction device. A controller main- 
tains the display of the image for the duration of 
the audio message. The controller reads a se- 

10 quence of images and audio messages from the 
data base, one image and one message at a time, 
and displays each image and plays back each 
message in turn. 

Such a system provides numerous advantages 

75 for the user. Any desired association between the 
images and the audio messages is available. That 
is, a given image may be is associated with more 
than one audio message, and vice versa. The sys- 
tem is then able to provide information to two 

20 different audiences, a different audio message be- 
ing directed to each audience. Also, if a library of 
image data files and a library of audio data files are 
stored in the data base, pairing up different audio 
messages with different images only requires ed- 

25 iting a presentation sequences file contained in an 
EEPROM memory in which IDs of the paired files 
are stored. While, in many cases, the data bases 
are stored on media such as digital compact discs 
which cannot be overwritten or edited, it is simple 

30 to edit the presentation sequences contained in 
EEPROM memory. 

The present invention allows for arranging sub- 
sets of the images and audio messages to be 
grouped into sequences. A sequence of images 

35 and audio messages having related subject matter 
are displayed in sequence, responsive to a simple 
user command, such as pushing a push button. A 
controller which controls the reading, displaying, 
and playback of the images and audio messages 

40 stored as data files in the data base includes 
programming for reading, displaying, and playing 
back a sequence of such images and audio mes- 
sages. 

45 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a system block diagram showing both 
a recording system for writing image and audio 
information onto a digital storage medium (i.e., a 
50 compact disc) and a playback system for read- 
ing the information to display images and play 
back audio messages; 

FIG. 2 is a more detailed block diagram of the 
playback system of FIG. 1 ; 
55 FIG. 3 is a schematic representation of a pre- 
sentation sequences file according to a first em- 
bodiment of the invention; 
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FIG. 4 is a schematic representation of the im- 
age data files and audio data files on the digital 
storage medium of FIG. 1 ; 
FIG. 5 is a schematic representation of a pre- 
sentation sequences file according to a second 
embodiment of the invention. 

DETAILED DESCRIPTION 

In accordance with the invention, digitized im- 
ages and audio information are stored as image 
and audio data files in the manner of a library in a 
digital storage medium, i.e., data base. This data 
base is preferably an optically encoded compact 
disc. Audio messages may be associated with im- 
ages, such that the audio message is played back 
while the image is displayed, in a manner to be 
discussed. Once such a library is programmed 
onto the write once digital storage medium, it is 
normally impossible to change the contents of the 
digital storage medium. 

Accordingly, a preferred digital storage me- 
dium is a digital disc having data encoded thereon 
to be read optically, such as a compact disc similar 
to those commonly used for recording music and, 
increasingly, computer data. Of course, the method 
and apparatus according to the invention are not 
limited to compact disc applications, but could be 
practiced with other mass storage media as well. In 
a preferred mode for practicing the invention, a 
user provides images and audio messages to be 
encoded onto a disc using suitable equipment at a 
facility set up for programming such discs. 

FIG. 1 is a simplified block diagram showing a 
compact disc 4 which serves as a data base for 
digitized images and audio messages stored as 
image data files and audio files thereon. There is 
also shown both a system for encoding the disc 4 
and a playback system for displaying the digitized 
images and playing back the audio messages. 

A disc programming system, shown in the up- 
per half of FIG. 1, resides at the facility of a 
photofinisher or a sound studio. In the former case, 
a customer delivers a roll of film to be developed, 
along with audio messages recorded on a suitable 
medium such as audio tape. In the latter case, the 
customer provides developed film bearing the im- 
ages to be digitized, and an audio technician as- 
sists in recording the audio messages. 

The programming system includes a recording 
device, shown as a CD (compact disc) recorder 2, 
which records information onto the CD 4. The re- 
corder 2 is controlled by a controller shown as a 
user interactive workstation 6, which includes a 
computer, a monitor, and suitable software and 
interfaces. 

The workstation 6 is coupled to receive image 
data from an image data source shown as a film 



scanner 8, which reads images from a film strip 10. 
The scanner includes a suitable color sensing de- 
vice for scanning a selected film image as an array 
of pixels and producing color pixel signals. This 

5 sensing device preferably includes a CCD (charge 
coupled device) array having suitable color filtering 
for sensing a set of primary colors. The scanning 
device produces digitized pixel data representative 
of the magnitudes of each primary color at each 

w pixel location. 

The workstation 6 is also coupled to receive 
audio data from an audio data source shown as an 
audio tape deck 12. Prerecorded audio messages, 
including voice, music, sound effects, or a com- 

75 bination thereof, depending on the application, are 
made in a suitable recording studio. Alternatively, 
the customer may make the recordings himself on 
home audio equipment. A master tape bearing the 
audio messages is then played on the tape deck 

20 12. If the audio messages on the tape are analog, 
then suitable A/D conversion is made. 

The controller 6 programs the digitized audio 
messages and images as audio and image data 
files on the disc 4. In accordance with conventional 

25 arrangements for storing data files on mass storage 
systems, the files are named, i.e., assigned IDs, 
and are addressable on the disc. Suitable utility 
files are provided for accessing desired ones of the 
image and audio data files by address. Such files 

30 are created by the controller 6 under operator 
command and programmed onto the disc 4 by the 
recorder 2. In accordance with the invention, how- 
ever, utility files can also include presentation se- 
quences files used for the purpose of defining 

35 associations between image and audio data files, 
so that while a selected image is displayed, an 
associated audio message is played back. Further- 
more, the image presentation order and the associ- 
ation between image and audio data contained in 

40 the utility file on the disc 4 can be superseded by 
programming a different order or associations into 
an EEPROM memory located in the player 16. How 
this is done will be described below. 

FIG. 1 additionally shows a playback system in 

45 accordance with the invention for displaying im- 
ages and playing back associated audio messages. 
The playback system is preferably a commercial 
CD player which may be coupled by the 
customer/user to a display device such as a televi- 

50 sion for displaying the images. The associated 
audio messages may be played back through the 
audio system of the television. If a multimedia 
presentation is to be directed to a large audience 
or presented in a noisy environment, the asso- 

55 ciated audio messages may be played back 
through a public address system or an audio 
playback system such as a home stereo system, 
which are also coupled to the CD player as appro- 
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priate 

To operate the system, the disc 4 is inserted 
inside a CD player 16. User commands directing 
selected images to be displayed and associated 
audio messages to be played back are entered 
through a user control 18. Image data from the 
image data file read from the disc 4 is provided by 
the player 16 to a display device shown as an 
NTSC television display 20. 

As per the user control, the audio data file 
associated with the image data file is also read, 
and the audio data is provided to an audio 
playback system, which may be the audio system 
of the television display, or a separate audio or 
public address system. The audio playback system 
is shown as including an audio amplifier 22 and a 
loudspeaker 24. 

Turning now to FIG. 2, there is shown a more 
detailed block diagram of the playback system 
shown on the bottom part of FIG. 1 . Corresponding 
components are numbered similarly. FIG. 2 primar- 
ily shows a more detailed block diagram of the CD 
player 16 of FIG. 1. The player 16 includes a 
controller 26. Responsive to user commands 
(discussed below), the controller 26 causes se- 
lected information to be read from the disc 4. The 
CD player preferably includes a disc reader 28, 
having a laser pickup movable across the face of 
the disc 4 (e.g., radially) for scanning a desired 
portion of the face of the disc 4 to read information 
from a desired address. A conventional motor ap- 
paratus is employed for rotating the disc 4, and for 
moving the laser pickup across the face of the disc 
4 to access a desired portion thereof. The informa- 
tion read from the disc includes image and audio 
data files themselves, and utility files containing 
address information for the image and audio data 
files. Also, as will be discussed below, information 
about associations between image and audio data 
files is read. 

Image and audio data files read from the disc 4 
are provided to a deformatter 30, which strips off 
headers or other overhead from the files which 
were read. There remains only digitized image 
pixel information, or audio samples, depending on 
the type of file which was deformatted. The pixel 
information and audio samples are, respectively, 
written into an image memory 32 and an audio D-A 
converter 34. Image memory 32 may be imple- 
mented as read/write random access memory 
(RAM). 

As described above, the image data from 
memory 32 is provided to the display 20 under 
control of the controller 26. Interface components 
for converting the digital image into an analog 
video format appropriate for the display 20 are 
included within video D-A converter 33. 



Also, the audio data is supplied from the audio 
D-A converter 34 to the audio system, which in- 
cludes the amplifier 22 and the loudspeaker 24. 
The controller 26 keeps track of the time required 

5 for playing back the entire audio message. This 
way, the controller 26 maintains the image on the 
display 20 for the length of time required for com- 
pleting the audio message. 

The playback system includes a commercial 

w compact disc player which may be used in the 
user's home, coupled to a standard television. In 
this case, the compact disc player is controlled 
through its front panel or through a remote control 
coupled, for instance by an infrared beam, to the 

75 disc player. 

In other applications, such as a public display 
in a museum or trade show, simplified controls for 
members of the public or audience passing by are 
provided. An example of such a simplified control 

20 is described in a co-pending EP patent application 

Serial No. 92913638.0, filed , entitled "A 

Selector for A Display Device" by J. Weldy, as- 
signed to the assignee of the present invention and 
the disclosure of which is herein incorporated. For 

25 instance, a user input 38 includes a plurality of 
push buttons corresponding with various images 
and associated audio messages. A user simply 
pushes a button labeled for a desired subject. 
Responsive to the user pushing the button, the 

30 controller 26 directs the reader 28 to read appro- 
priate image and audio data files whose contents 
relate to the desired subject The system then 
operates as described above to display the image 
and play back the audio message. 

35 In accordance with the invention, the image 

and audio data files are associated with each other 
in a presentation sequences file located either on 
the disc 4 or in the EEPROM memory module 29. 
This is done in order to provide for a multimedia 

40 presentation, in which images and audio messages 
which were produced to correspond with each oth- 
er are displayed and played back concurrently with 
each other. A storage medium such as a digital 
compact disc has a storage capacity large enough 

45 to include many images and audio messages. De- 
pending on the application, conveying desired in- 
formation includes displaying a sequence of im- 
ages, and playing back a corresponding sequence 
of messages. Preferably, a user should be able to 

50 view a sequence of images by pushing a single 
button once. The user is given a choice of several 
buttons, each one corresponding to a different se- 
quence of images and audio messages. In some 
cases, a given image appears in different se- 

55 quences, or requires a different associated audio 
message for each sequence in which it appears. 
From this summary of desired features in such a 
system, it will be appreciated that flexibility is an 
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important objective. 

Therefore, in accordance with the invention, a 
method is provided for mapping image and audio 
data files together, i.e., for associating image and 
audio data files stored on the disc 4. A suitable 
apparatus for supporting the method, such as suit- 
able presentation sequences files on the disc 4 or 
in the EEPROM memory module 29 for facilitating 
association between image and audio files, is also 
provided. 

Figure 3 illustrates the organization of data 
contained within the presentation sequences file 
100 on the disc 4 or the EEPROM memory module 
29 in accordance with a first embodiment of the 
invention. The data is divided into two sections, a 
pointer table section 110 and a presentation se- 
quence section 160. The pointer table 110 stores a 
multiplicity of pointer entries for a multiplicity of 
different presentations which may be constructed 
using the images and audio sequences contained 
on the disc 4. The pointer table 110 includes the 
addresses within the presentation sequences file of 
the first image for each of the multiplicity of dif- 
ferent presentations. For example, the Program #1 
address stored in location 112 of the presentation 
sequences file contains the address of location 
122, which stores the disc image number of the 
first image for Program #1, which in this case is 
also the first image on the disc, image #1. Like- 
wise, the Program #8 address stored in location 
116 of the presentation sequences file contains the 
address of location 142, which stores the disc 
image number of the first image for Program #8, 
which in this case is image #30. 

The presentation sequence section 160 con- 
tains a multiplicity of sequences such as sequence 
120 and sequence 140. In particular, there is one 
sequence for each of the Programs listed in the 
pointer table 110. The sequence 120 contains a 
sequential order of images and audio segments for 
Program #1, and the sequence 140 contains a 
sequential order of images and audio segments for 
Program #8. The sequence 120 contains entries 
122- 132 which lists all of the images and audio 
segments on the disc, in sequential order, with 
each audio file number following the appropriate 
image file number. When the user selects Program 
#1, the player will therefore play back all of the 
images and associated audio segments on the 
disc, in the order in which the images appear. The 
sequence 140 contains entries 142-154 which lists 
the images in a different order from that of se- 
quence 120, and does not include all of the image 
numbers. The sequence 140 also associates audio 
segments with images of different numbers, such 
as entries 142 and 144, which associate audio 
segment #12 with image #30. The sequence 140 
further associates multiple audio segments with 



one image, such as entries 146-150, which asso- 
ciate image #5 with audio segment #5 and also 
with audio segment #15. When the user selects 
Program #8, the player displays image #30 while 

5 playing audio segment #12, it then displays image 
#5 while playing audio segment #5 followed by 
audio segment #15, and finally it displays image #1 
while playing back audio segment #20. 

Figure 4 represents the image data files 200 

w and the audio data files 300 stored on disc 4. Each 
image file, for example image file 240 which con- 
tains the data representing image #1 , includes both 
header information, such as header 242 and image 
data, such as image data 244. The image data file 

75 244 is a very large file, since it contains the digital 
image data scanned from an image on filmstrip 10. 
The header information includes additional presen- 
tation control information for each image as de- 
scribed in the aforementioned Parulski '265 patent 

20 application. There can be a different number of 
audio segment files 340, 350, 360, 380, etc. than 
there are image files 240, 250, 260 etc. recorded 
on disc 4. 

The image numbers and audio numbers in 

25 presentation sequences file 100, such as Image #1 
in location 122 and Audio segment #1 in location 
124 provide the location of where the data for the 
appropriate image or audio segment is located on 
the disc 4. In one implementation, this is done 

30 directly, by storing the actual address of the loca- 
tion on disc 4 where the image data file or audio 
data file begins. For example, location 122 of pre- 
sentation sequences file 100 would contain the first 
address of Image #1 header 242 on disc 4. In a 

35 second implementation, the image numbers and 
audio numbers in presentation sequences file 100 
would indirectly provide the location of where the 
data for the appropriate image or audio segment is 
located on the disc 4, by providing the image 

40 number or audio segment number. An intermediate 
table containing the actual addresses of the loca- 
tion on disc 4 where the image data files and audio 
data files begin is then used to determine the 
starting location of the appropriate audio or data file 

45 on disc #4. 

In a system employing the file 100 shown, a 
user input device 38 includes multiple push-buttons 
respectively corresponding with the multiple se- 
quences contained in presentation sequences file 

so 100, for example, sequences 120 and 140. Each 
push button is labeled so as to inform the user 
about what information is contained in each se- 
quence. When the user pushes one of the buttons, 
the controller 26 receives a signal so indicating. In 

55 response to the signal, controller 26 accesses the 
corresponding sequence in the presentation se- 
quences file 100 by its pointer entry in pointer 
table 110. The controller employs a pointer or other 
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suitable program means for keeping its place in the 
program sequence section 160. As the pointer 
moves through the program sequence, the control- 
ler 26 reads the image IDs, one at a time. For each 
image ID, the controller 26 then goes to a file in 5 
FIG. 4, and reads the header and the image data 
file. Once the image has been read into image 
memory 32, controller 26 identifies the audio data 
files which follow the image file, and reads the 
audio files. The audio messages are played back w 
while the image is displayed. 

The controller 26 keeps displaying the image 
as long as the audio message file is being read. 
Afterward, the image continues to be displayed for 
a few seconds while the next image is located from 75 
presentation sequences file 100. Alternately, a 
longer period of silence could be inserted between 
the end of the audio message and the beginning of 
a new image and an audio message. 

In this manner, each image of a sequence is 20 
displayed, one by one, and each associated audio 
message is played back, until the end of the file 
marker is reached. At that point, the system returns 
to a quiescent state until the next button is pushed. 

Figure 5 illustrates the organization of data 25 
contained within a presentation sequences file 500 
on the disc 4 or the EEPROM memory module 29 
in accordance with a second embodiment of the 
invention. In this embodiment, the presentation se- 
quences file is also divided into two sections, a 30 
pointer table section 510 and a presentation se- 
quence section 560. The pointer table 510 again 
stores a multiplicity of pointer entries for a mul- 
tiplicity of different presentations which may be 
constructed using the images and audio sequences 35 
contained on the disc 4. The presentation se- 
quence section 560 again contains a multiplicity of 
sequences such as sequence 520 and sequence 
540. In particular, there is one sequence for each 
of the Programs listed in the pointer table 510. 40 

The sequences now contain only image num- 
bers, and the audio files which are played back as 
each image is displayed have the same file num- 
ber as the image file number. Alternately, the audio 
file numbers could be contained within the header 45 
for each image number. For example, the audio 
segment for Image #1 would be indicated in the 
header #1 242 in Figure 4. The sequence 520 
contains a sequential order of images for Program 
#1, and the sequence 540 contains a sequential 50 
order of images and audio segments for Program 
#10. The sequence 520 contains entries 522-530 
which lists all of the images on the disc, in sequen- 
tial order. When the user selects Program #1 , the 
player will therefore play back all of the images 55 
and associated audio segments on the disc, in the 
order in which the images appear. The sequence 
540 contains entries 542-546 which lists the im- 
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ages in a different order from that of sequence 520, 
and does not include all of the image numbers. In 
this implementation, it is not possible to associate 
more than one audio segment with a single image 
file. 

While I have shown and described an embodi- 
ment in accordance with the present invention, it is 
to be understood that the invention is not limited 
thereto, but is susceptible to numerous changes 
and modifications as known to a person skilled in 
the art. I therefore do not wish to be limited to the 
details shown and described herein, but rather in- 
tend to cover all such changes and modifications 
as are obvious to one of ordinary skill in the art. 
The invention may be summarized as follows: 

1 . An apparatus for use with a system including 
a digital data base for storing respectively cor- 
responding digitized images and digitized audio 
messages, for controlling concurrent reproduc- 
tion of digitized images on an image reproduc- 
tion device and audio information on a sound 
reproduction device, said apparatus comprising: 

program means, responsive to a user com- 
mand, for reading image data from one of the 
image data files and coupling the image data to 
an output for display on the image reproduction 
device; 

program means for identifying an associated 
one of the audio data files containing a digitized 
audio message which is to be played back con- 
currently with the display of the image data; and 

program means for reading audio data from 
the associated audio data file and coupling the 
audio data to the output for playback on the 
sound reproduction device; 

whereby the audio message is played back 
by the sound reproduction device as the image 
is displayed on the image reproduction device. 

2. An apparatus as recited in 1, wherein the 
means for identifying include: 

a presentation sequences file stored in the 
data base and including a list of the image data 
file IDs and audio data file IDs associated there- 
with; and 

a controller including programming for read- 
ing image and audio data files whose IDs ap- 
pear in the presentation sequences file, and 
displaying the image and playing back the audio 
message respectively digitized therein. 

3. An apparatus as recited in 2, wherein the 
presentation sequences file includes a plurality 
of pairs of IDs, each pair of IDs including a first 
ID of an image data file and a second ID of an 
audio data file associated with the image data 
file. 

4. An apparatus as recited in 2, wherein the 
presentation sequences file includes a plurality 
of groups of IDs, each pair of IDs including a 
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first ID of an image data file and one or more 
IDs of an audio data file associated with the 
image data file. 

5. An apparatus as recited in 2, wherein the data 
base includes: 5 

a first library of image data files, each im- 
age data file having an ID and including a head- 
er and digitized image data; and 

a second library of audio data files, each 
audio data file having an ID and including a to 
header and digitized audio data. 

6. An apparatus as recited in 5, wherein each 
image data file header includes an ID of an 
associated audio data file. 

7. An apparatus as recited in 5, wherein the 75 
means for identifying further include a presenta- 
tion sequences file including pairs of data file 

IDs, each pair including a first ID for an image 
file and a second ID for an associated audio 
data file. 20 

8. An apparatus as recited in 7, wherein the 
presentation sequences file is stored in a digital 
data base. 

9. An apparatus as recited in 8, wherein the 
presentation sequences file is stored in a sepa- 25 
rate EEPROM memory. 

10. An apparatus as recited in 9, wherein the 
EEPROM memory is removable. 

11. An apparatus as recited in 5, wherein the 
means for identifying further include a presenta- 30 
tion sequences file which contains multiple se- 
quences of IDs for images which are to be 
displayed in sequences responsive to user com- 
mands. 

12. An apparatus as recited in 11, wherein: 35 
the apparatus further comprises multiple 

manually operated controls respectively corre- 
sponding with the multiple sequences; and 

the means for identifying further include 
means for reading the image and audio data 40 
files making up a selected sequence responsive 
to an actuation of the respective manually op- 
erated control by a user. 

13. An apparatus as recited in 11, wherein the 
means for reading and coupling image data in- 45 
elude means for displaying each image of the 
sequence for a length of time required for play- 
ing back the audio message associated with the 
image. 

14. An apparatus as recited in 11, wherein the 50 
means for reading and coupling image data and 
audio data further include means for pausing for 

a predetermined time between successive im- 
ages of the sequence. 

15. An apparatus, for use with a system includ- 55 
ing a digital data base for storing image data 
files containing digitized images and audio data 
files containing digitized audio messages, for 



controlling concurrent reproduction of digitized 
images on an image reproduction device and 
audio information on a sound reproduction de- 
vice, the apparatus comprising: 

a digital data base reader for reading the 
digitized images and audio messages; 

a controller coupled to the digital disc read- 
er for directing the reader to read a selected 
one of the digitized images and an associated 
one of the audio messages responsive to a user 
command, and further coupled to an output for 
providing the digitized image and audio mes- 
sage respectively thereto, for display and 
playback. 

16. An apparatus as recited in 15, wherein each 
image data file and each audio data file has an 
ID. 

17. An apparatus as recited in 16, wherein the 
header of each image data file further contains 
the ID of an associated audio data file. 

18. An apparatus as recited in 16, wherein the 
data base further includes a presentation se- 
quences table which lists a series of groups of 
data file IDs, each group including an image 
data file ID and one or more associated audio 
data file IDs. 

19. An apparatus as recited in 18, wherein the 
presentation sequences file is stored in a digital 
data base. 

20. An apparatus as recited in 19, wherein the 
presentation sequences file is stored in a sepa- 
rate EEPROM memory. 

21. An apparatus as recited in 19, wherein the 
EEPROM memory is removable. 

22. An apparatus as recited in 16, wherein the 
ID for each data file is related to its address in 
the data base. 

23. An apparatus as recited in 16, wherein the 
ID for each image data file is related to one of a 
first sequence of integers, and the ID for each 
audio data file is related to one of a second 
sequence of integers. 

24. An apparatus as recited in 16, wherein the 
data base further contains a presentation se- 
quences file containing multiple sequences, 
each sequence including at least one data file 
ID, data file IDs of each sequence being in a 
predetermined order, whereby, responsive to a 
user command selecting a sequence, images 
and associated audio messages are displayed 
and played back in an order corresponding with 
the order of data file IDs in the selected se- 
quence. 

25. An apparatus as recited in 24, wherein each 
sequence within presentation sequences file is 
associated with a pointer table entry. 

26. An apparatus as recited in 25, wherein each 
sequence within the presentation sequences file 
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includes an end-of-sequence delimiter. 

27. An apparatus as recited in 15, wherein the 
digital data base includes a digital optical disc, 
and the digital data base reader includes a laser 
pickup. 5 

28. A method for operation of a system includ- 
ing a digital data base for storing respectively 
corresponding digitized images and digitized 
audio messages to control concurrent reproduc- 
tion of digitized images on an image reproduc- w 
tion device and audio information on a sound 
reproduction device, the method comprising the 
steps of: 

reading image data from a selected one of 
the image data files and coupling the image 75 
data to an output for display on the image 
reproduction device; 

identifying one ore more audio data files 
containing digitized audio messages which are 
to be played back concurrently with the display 20 
of the image data; and 

reading audio data from the associated 
audio data file and coupling the audio data to 
the output for display on the sound reproduction 
device; 25 

whereby the corresponding audio messages 
are played back by the sound reproduction de- 
vice as the image is displayed on the image 
reproduction device. 

29. A method as recited in 28, wherein: 30 
the step of reading and coupling image data 

includes reading the image data file from a first 
region of memory space in the data base; and 

the step of identifying an associated audio 
file includes identifying a second region of 35 
memory space in the data base. 

30. A method as recited in 28, wherein the step 
of identifying an associated audio file includes 
reading a header associated with the image data 

file and extracting an audio file ID from the 40 
header. 

31. A method as recited in 28, wherein the step 
of identifying an associated audio file includes 
reading a pair of file IDs from a presentation 
sequences file, the pair including a first ID of the 45 
image data file and a second ID of the asso- 
ciated audio data file. 

32. An apparatus as recited in 31, wherein the 
presentation sequences file is stored in a digital 
data base. 50 

33. An apparatus as recited in 32, wherein the 
presentation sequences file is stored in a sepa- 
rate EEPROM memory. 

34. An apparatus as recited in 33, wherein the 
EEPROM memory is removable. 55 

35. A method as recited in 28, further compris- 
ing the step of repeating the steps of reading 
and coupling image data, identifying an asso- 



ciated audio file, and reading and coupling audio 
data a plurality of times to display a sequence 
of images and play back a sequence of respec- 
tively associated audio messages responsive to 
the step of entering a program command. 

36. A method as recited in 28, wherein the step 
of reading and coupling the image data includes 
coupling the image to the output for a length of 
time required for playing back the audio mes- 
sage associated with the image. 

37. A method as recited in 35, wherein the step 
of reading and coupling the image data includes 
coupling the image data to the output for a 
length of time required for playing back the 
audio message associated with the image; and 

the method further comprises the step of 
pausing for a predetermined time between suc- 
cessive images of the sequence. 

Claims 

1. An apparatus for use with a system including a 
digital data base for storing respectively cor- 
responding digitized images and digitized 
audio messages, for controlling concurrent re- 
production of digitized images on an image 
reproduction device and audio information on a 
sound reproduction device, said apparatus 
comprising: 

program means, responsive to a user com- 
mand, for reading image data from one of the 
image data files and coupling the image data 
to an output for display on the image re- 
production device; 

program means for identifying an asso- 
ciated one of the audio data files containing a 
digitized audio message which is to be played 
back concurrently with the display of the im- 
age data; and 

program means for reading audio data 
from the associated audio data file and cou- 
pling the audio data to the output for playback 
on the sound reproduction device; 

whereby the audio message is played 
back by the sound reproduction device as the 
image is displayed on the image reproduction 
device. 

2. An apparatus as recited in claim 1 , wherein the 
means for identifying include: 

a presentation sequences file stored in the 
data base and including a list of the image 
data file IDs and audio data file IDs associated 
therewith; and 

a controller including programming for 
reading image and audio data files whose IDs 
appear in the presentation sequences file, and 
displaying the image and playing back the 
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audio message respectively digitized therein. 

3. An apparatus as recited in claim 2, wherein the 
presentation sequences file includes a plurality 
of pairs of IDs, each pair of IDs including a first 
ID of an image data file and a second ID of an 
audio data file associated with the image data 
file. 

4. An apparatus as recited in claim 2, wherein the 
presentation sequences file includes a plurality 
of groups of IDs, each pair of IDs including a 
first ID of an image data file and one or more 
IDs of an audio data file associated with the 
image data file. 

5. An apparatus as recited in claim 2, wherein the 
data base includes: 

a first library of image data files, each 
image data file having an ID and including a 
header and digitized image data; and 

a second library of audio data files, each 
audio data file having an ID and including a 
header and digitized audio data. 

6. An apparatus as recited in claim 5, wherein 
each image data file header includes an ID of 
an associated audio data file. 

7. An apparatus as recited in claim 5, wherein the 
means for identifying further include a pre- 
sentation sequences file including pairs of data 
file IDs, each pair including a first ID for an 
image file and a second ID for an associated 
audio data file. 

8. An apparatus as recited in any of the preced- 
ing claims, wherein the means for identifying 
further include a presentation sequences file 
which contains multiple sequences of IDs for 
images which are to be displayed in se- 
quences responsive to user commands. 

9. An apparatus as recited in any of the preced- 
ing claims wherein: 

the apparatus further comprises multiple 
manually operated controls respectively cor- 
responding with the multiple sequences; and 

the means for identifying further include 
means for reading the image and audio data 
files making up a selected sequence respon- 
sive to an actuation of the respective manually 
operated control by a user. 

10. An apparatus as recited in any of the preced- 
ing claims, wherein the means for reading and 
coupling image data include means for dis- 
playing each image of the sequence for a 



length of time required for playing back the 
audio message associated with the image. 

11. An apparatus as recited in any of the preced- 
5 ing claims, wherein the means for reading and 

coupling image data and audio data further 
include means for pausing for a predetermined 
time between successive images of the se- 
quence. 

10 

12. An apparatus, for use with a system including 
a digital data base for storing image data files 
containing digitized images and audio data 
files containing digitized audio messages, for 

75 controlling concurrent reproduction of digitized 

images on an image reproduction device and 
audio information on a sound reproduction de- 
vice, the apparatus comprising: 

a digital data base reader for reading the 

20 digitized images and audio messages; 

a controller coupled to the digital disc 
reader for directing the reader to read a se- 
lected one of the digitized images and an 
associated one of the audio messages respon- 

25 sive to a user command, and further coupled 

to an output for providing the digitized image 
and audio message respectively thereto, for 
display and playback. 

30 13. An apparatus as recited in any of the preced- 
ing claims, wherein each image data file and 
each audio data file has an ID. 

14. An apparatus as recited in any of the preced- 
35 ing claims, wherein the header of each image 

data file further contains the ID of an asso- 
ciated audio data file. 

15. An apparatus as recited in any of the preced- 
40 ing claims, wherein the data base further in- 
cludes a presentation sequences table which 
lists a series of groups of data file IDs, each 
group including an image data file ID and one 
or more associated audio data file IDs. 

45 

16. A method for operation of a system including a 
digital data base for storing respectively cor- 
responding digitized images and digitized 
audio messages to control concurrent repro- 

50 duction of digitized images on an image re- 

production device and audio information on a 
sound reproduction device, the method com- 
prising the steps of: 

reading image data from a selected one of 
55 the image data files and coupling the image 
data to an output for display on the image 
reproduction device; 

identifying one ore more audio data files 
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containing digitized audio messages which are 
to be played back concurrently with the dis- 
play of the image data; and 

reading audio data from the associated 
audio data file and coupling the audio data to 5 
the output for display on the sound reproduc- 
tion device; 

whereby the corresponding audio mes- 
sages are played back by the sound reproduc- 
tion device as the image is displayed on the 10 
image reproduction device. 

17. A method as recited in claim 16, wherein: 

the step of reading and coupling image 
data includes reading the image data file from 75 
a first region of memory space in the data 
base; and 

the step of identifying an associated audio 
file includes identifying a second region of 
memory space in the data base. 20 

18. A method or an apparatus as recited in any of 
the preceding claims wherein the presentation 
sequences file is stored in a digital data base. 

25 

19. A method or an apparatus as recited in any of 
the preceding claims wherein the presentation 
sequences file is stored in a separate EEPR- 
OM memory. 

30 

20. A method or an apparatus as recited in any of 
the preceding claims wherein the EEPROM 
memory is removable. 

35 
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